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(57) Abstract: When controlling a robot, a content instructed by a speech by an instructor is recognized by a speech recognition 
section (130) and a content instructed by a gesture is recognized by an image recognition section (120). According to a map database 
(150) containing a position of 
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It (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), 3 — P y 
(AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, 
FR, GB, GR, HU, IE, IT, LU, MC, NL, PT, RO, SE, SI, SK, 
TR), OAPI *#|* (BF, BJ, CF, CG, CI, CM, GA, GN, GQ, 
GW, ML, MR, NE, SN, TD, TG). 



an obstacle registered and the current position estimated by a self position estimation section (140), the map of the movement des- 
tination and a periphery of a particular position specified is referenced so as to judge the movement easiness by using a movement 
easiness judgement section (1 12) and an action is decided. When a movement instruction is given to the robot, the robot can respond 
in accordance with the situation. 
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*&wiz^ p*> hpmrnw. p*v hmm^s hwn^ 

10 

(that)j r-o*> (this)j fcif4:»3*«fc:j: D^^-S^i: <b&5 0 
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£fc, ^i¥6-6 3 8 8 3-5§-^$U£{3\ utfy h^tH"^^^^ 

20 ua>u z<D*7$y h<Dmn&mmwxii. ffimim^m&mfc^z^t 

25 
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mx, ftm&m^<D&m&&^xh2>tmm£thtcm&, mm&^&mmfeMx 

25 iE|g§&a> 6> ©8B«£U:g^V ^^>/f < 1 1> 2 o«±©ii4ri$ u HulSfTllJ^: 

x% *tfyvtmmm£bm.**(\mx%, mm±m^^ti^mm^u^y 
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m¥fM&w^<D&wj®%m&wm^z£?mi&^xh£\,\ 

&<£m®<D3&m\zM%- tx\ m^i>m®mmvtzwmim<Dwmzfcz 
15 fcttj&%:J8iz-tfrnmktez> 0 Mz-tf. mis.&W}mM,mwmux\ mmw^m 

s«r«ttw:&<. m^%<Dm^i>mm^xnte\,^tn?Lfbthz><Dx\ 
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Mm<D'p * < 1 1> v ^tti^ i o (Dnm&fcfe-t z>£?mj$,Lxt>£\,\ 

(there, this, that way) ^<£>Jf^fg{;: J; 9 ^»*g^«r \,tzM^\z. ^rOjg^ff 
^^ici^^mri: X\ b*<Dmm<D%\zftm z f'fe&*a C 

b&x%. %<di&^ vtf* btzm^&jEL<fct><>x^z>fammx%z>bbh 
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(there, this, that way) m<om^Bi^X Lfcm^f-^ ^Jg^fg 

£?>(^ affiant h^J|f^{c:*5VNT, BulEfrlft^:^ T y zf\z. J: 9 £ 

W^l- iOtil^^ri:^ if OJ^H^#{ctTljj^$r^j kit- 5 ^ £ 

, ^-O^x o h Mif ;^IE L < fc*>o TV ^«fe^T*# ZhbhlZ.^ 

15 zmm-tz. 

^p^g £fg!&-r 5 s^tsn^is: t , giiE g ttj^«>e» p)©^ ^ t 
hubs n aj? y h (Dm&tiLW. zmiz-r s g e&g#t^#i& £ , mm j*B«i^gfcft 
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4>-et5 0 fcsv^{i > Mi5n^> vmm-^mcD^yzf^cDm^mt u * 

^^fcM^rttSD^s/ Mct5r^^*t5. Sfc. r tf>£ 5 tr- 
io ^-^^n^^^i LTfll^$^7c:ci7jf5/ h$iJ^ci^^A(i N ^t^-^ 

TO** a. 
15 mufioffiwmw 
mmx&>z> 0 

m&tm-rzxm. ( c ) « % *jfi««©ts:;£;frifc. (d) 

25 ±««©K^ife*r^"^ 0 

mi omiz^ m^Lizmmzttirz!fc&&im&^-t7v-^^- bxhz> a 
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fiat *9&ffiu<Dntfy hMwmn&mmztiZAmmwtfv hRv> 
mnR 4 oibf^sr^-rs^i^a^^R 5 5 ^-cirt ten 

10 »2Htt,o#y NR^»f^$^Sfci6^^^«3t^U^mil|-efe6„ 

SR2Blfc?j*-*-.fc5te, o^yhRU fe&©WSSR l K:**L-eft,6<@<z>|18gji l 
1R (L) ~16R (L) *ffiz_X\,^ 0 fe&12fl©H*tt, JftSBI-aa^&H 

15 fcWHIifeffl (Zi»nfcfc>t>) oflfcTOi 1R, 1 1 L (^ffiOSrR, &m&Lt-fZ> 0 
CITRIC.) , (Y*ft) *t>9(Dj^g|til 2R, 12L, »d 

— ywjtt (Xtt) ^^«?WflSB8tSl 3R, 13L, J»*f5©try^-tt (YI4) 
Oii©14R, 14L, JElTOtfy^tt (Ytt) &ib*)<D&m®l 5R, 15 
L. S-i-©n-/U# (XfA) *t?«9(Dj£TOl 6R, 1 6 L^b*J^^iXTV>^ 0 

20 ^LT, m&Rl<DT\aZ&m 7R, 1 7 L^Ifc 9 #ft kttTV^o 

WgBRlte, Ji$M®51 1R (L), 12R (L), 13R(L),J&Bg 
Ml 4R (L), MBMflil 5R (L), 1 6R (L) £{I*l6 0 fl&BSftlS 1 1-13 
R (L) tmmWl 4R (L) ^JB§y ^51R, 5 1 L"C, Jg?|»gl5 1 4R (L) 
£&B8«&1 5~1 6R (L) (*T«§y^^5 2R, 5 2 LT-jgifc!r £*VCV>5 0 

25 JJpg&R 1 {i x flftgifilSUR (L) ~13R (L) UT±#R 2 fcag*g$;h, 
Z>o I2im MRl<b_b^R2i:<7)iS^^±^:y^^5 3i:LTffilB&^ 
UT^-To ±fcR 2iCteffc&R3Rtfm&R4frm%£&tlZ>kmz^ _hft:R2£ 

«SSPR3tt % W«P©lfy^«l (Y«) *^«9^WgSU5 3 1R, 3 1 L. W*B<Z> 
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D— /Vifa (X$ft) £:fc>9©WIMil5 3 2 R, 3 2L, BUR 3 &®M&lkZ>tclt)<D 
mt)$k (Zm *fclJ«ti3 3R, 3 3L, MM<DK'v?-$fy (YWO *fc>«9 
©Wffi|i3 4R, 3 4L, 3L-g&\BlM£itZ>til£>(Dmjj®l (Zftfc) £ ;b 9 OlBSIW 
tfi3 5R, 3 5L, ^-i-<Dfc°^^$ft (Y#) *MJO¥fii3 6R, 36L, 
5 ISXXJPmv-^m (Xitt) *^9c^BltS3 7R, 3 7 L^Pj#|^$tL5o #1Ttf> 
W^K3 8R, 3 8 L^«9#t1-t>tb-CV^ 0 

lbfcfr*>. J»B$PR3fi, mmffi3 1 R (L), 3 2R(L), 3 3 R ( L) , MSB 
fi&3 4R (LK ^5BISJ5 3 5 R (L), #^§8^3 6 R (L) «Mt*.TV*5 0 WW 
i31-33R (L) <bMSBfi^3 4R (L) fit, _LJg§y y^54R (L) T\ M 
10 TO3 4R (L) t^gg^3 6R (L) f*T$G y 5 5 R (L) -Cjgjg^H 

•£LT, ^R4fi, ^R4<D^wh^$r^M-r6-i-Bfl^4 1 
S-rS-TMfifi4 2 iSr^LTV^o 

15 £>*K 3*ffffc:r*Lbtf>6 * 2= 1 2^»|flgJi<|rig^^T'^tl)-r-5C^t?, 

j?fS©fBfcS:fT frit 5 Z. t So 
20 »2BllC^*a< % &mffi<DTjj<D&1®l 7R (L) IC 6 tti;*5-fe 

i~5^S;0<D3;fr|p]/&#F x, F y, F z k*Er*- * > F©3*|rIMMx, My, 
Mz iSrtfeW-TS. 

^l-ligliir^V F3 8 R (L) 0Dffi(^«l5]®(D6^-ir^-^6 2^ 

fe*J-^S^^3^'fR]^F x, Fy, F z ^ > h(D Sjjftf&ftMx , M 

y, Mz t&tfetttt**. 
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(H^it-f) zfrLxmrnisttMy 5 1 r (d, riy>:?52R (d 

faJ^gJgiftgBR 5 fCfi, «|pa=y MO 0^<b^SltXi^$tt, ^^=5, h 
5 1 OOWt tij|2Lfc^--fe^6 1~6 3 &<f<£>fctj7} (0^tf>1M:£:<7[>fc#>n rff 5/ 

1 0 ofrbfDm&mTjkizmz* vmrnzunz, fsm^y moos, # 

R 5}ditSi^$ttfc$«J^^5/ h 1 0 0^j^jo^^5r^-r o faJ#P^-~;/ MOO 

15 um=*-~y Fiooa, tp&mmmw (cpu) iooa, mmmmi oob, 

Aaj^^7x^ (I/F) lOOC^tn^ytWCfc!), !EHt£E 

mURHZ.^ wim^tc&MWl 1 R (L) ~15R (L) 6$ft^j-fe^ 
20 6 1 aMtx. ktU 6 6 1 £>l&fflfI-5§-}^ f&|#P^ ^100 [CA^ $ 

«-B9flSl 1R (L) -1 5R (L) ttu flitl^ - 5, M OO^^^ig®,^^ 

25 &£*xtv^ 0 *^c, im±^6 3<D&m<fm-i^ mm*--? h 1 oom 

«»R3K»^ tfTCBUfcBMjS3 1R (L) -3 7R (L), /^K38R (LK 
yhl 0 0KA7J&*K MW3 1 R (L) — 3 7R (Lh '^S K3 8R (L) ft, 
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(Charge-Coupled Device)^ ^743, ^^44, GP S (Global Positioning 
System)glf£g4 6, it-r^f u±>>9>4 7 X ±&^^ir^4 8 ^fg^fci?)^ 

CCD^74 3lt 3&W©0§^fc:fE*to> rgMfeggj U GPS^f 

f|4 6, v?Wn-fe^4 7, i&a^-fe^lM 8 r g B&g&ffl&g J tC*g^ 

10 o^g£$ib{£#x.-Ct>«fcv\ ) 

4 7, «HK«t-fe^4 8a>fc©tfefflfg-J§-tt % ^3.^5, h i o OKA^tk "i" 

«M*a=y h i o o<Dft%imi&&£<onmiz.mw-tz>o imer*, mm 

15 zl- y M o 0 <DrtSM**J*&*H-«1IB:/n y 2 HIT**) -5, fc*5 x ftflflpM yhl 
vy^ARXfy*— *f£S<5^TCPU 1 0 0 Aj^^SIiSrtT 9 - 

m4 m^m-r & 5 mm*-- ynoou, u-c®^a$u 120, t 

20 r«13 0, g e&g«i3£3fB 1 4 0 , Jffl-T*— *1 50i, ^tlbO 

25 MffeSMft 12 0 it, 2^©CCD^^74 3, 43 ^fgi LfcflHfeffiftjftSpi 

C CD*^7 (ftHfe&B) 4 3, 4 3te, &m<Dffim*nZ>tillt>ttlJ*7R 
^^7©2o«!), ^nf^Tjit^tlfcl^^, W^A^gPl 2 7C 
A#£*lS 0 CCD*^74 3, 4 3lt n # h <D&£<7) @ KLfB^-f 5 t>^t? 
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ntft> hR^$PR4(^tt^4xTV>-5 0 

5 m&raftis 1 2 o tt,}g^#©m^«rjE u < &m+zizib x mmmM 121, 

&tb4*rimtt&l 22, ^*^^irW«SRl 2 3, £9MMSl 2 4, 

EiSKSB12 1» % 2oOCCDA^743, 4 3 •? ii/ufc|^^© 

0^^7*0'/^ (09*.fil 6 X 1 6 Miff) -Q-fxxyV^ryJ-istri&'fjS, - £ 

fc*5, tSU^rZ i Ucit, CO|liZl^tSCCD*^7 4 3^?)W 
H£B ttSi, ft© (1) 5*rcjfc«>5 

20 

D = B x i/Z ... (l) 
fc*5, CCD7j^743, 4 3 f4 2 ^{dPS^-f , 3 £fiJLh0>;& ;* 5 Sr/BWCtS 
25 T\ LfcTJ p< 7 £g2p7J ^7i: LT.fdlOTJ ^ 9 £ ^iHS^v ^t, 

&W}VoftMM%K 1 2 2 {4, mi&AJjtfi 12 7 ^f,A7J ^4x/b^^iM(^^ic:*5V^ 
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§#12002-07 76 73 (#i2 0 0 3- 0 3 9 3 6 5^i[) 
5 tiX\,^Z>&?^ W^^tS^^-^tyf (ccd*^7) ^ * 

MmA&mmvtcmw?mmv&z>mm2 002-234066 icnB^$ 
w-T5„ #iix.ff> MmA*mmLtc&ffmmxhz>mM2 ooi-onsis 

20 (^|2002-21 6 1 2 9^i) ^^$ttTV^^ J; o 1^ CCD^7 
25 Jf ^SKfltift 12 611 ig&®{££<£/B ^Xl%7f;%<Dm&XteyLmj7fa*W 

m^zz tiz.±v)m*m*M^m*m®z&MTzmmz^ir2> 0 mm 
A^mm^tcWfftamxh?>mm2 0 02-23189 9tcis«c$*i-c^5<k 5 
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m^$sig#^gB 1 3 1 (m^famftfe^®) &m u m^mwmn nm 

r ^ C j r^g- o j (here, that way) J? % fg^igt' J; t) #j£ $ *Lfc«#«rtt 9 
^fJfrSMMU 13 011 PI&f&ifcgB 12 0 ^SfBUfe Lfc^# t n jJ? 5/ h R <D^M 

#^5 T-rj, r^tbj. r- 0 *>j, r-*><bj (here, this, this way, this one) t£¥ 
m^M^h^mm. flx.if^f M^4"5t Lfc^l mW®i 
fc*>\ «l»13 1li, r- -j (here) tfofcf^lclt WiW\*M 

m-tzmnt u-ciBfg&u (this one) ^&s»T5 

25 ffl»iLTB«u 8tft& rco*>j, r-*,c,j (this) ^ifi:iofc^i:(t 

(here, this one) t Pg|i:W«LfcO , ^TlRj^lJ-fflfg (this 
way) tLTliUciJf5, #£{£fi<a&^&U:o^T{;m^t-<5;^ 
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(this or this way) tltcjffa bWt&X'Z 3<> S^tfS ji,fcfc 

it^M<D{i@X-*> 9 , r»o*,j, r-tj^j (this or this way) <£>Ic9fcteii;^# 

m ft a* 5 ^ep v a3 1 mmx # 6 o 

ftTtttfit^Zu l"^tLJ, t^oibU t^-ibb J (there, that, that way, that one) 

LTV^5<D;dSii?re&>5a>P>, r-tbJ, rco^j % r-^^j (here, this, 

this way, this one) xm^-f^^X *) fc&Vt£ML &l/fB#£>V^jgi72&Ji-r<Z> 

is o*>.u r^kj &if«u r^e-j, r^rttj tina^^Lfco, jffa&Tjk-tmm 

bi, i^Tbi Mft^p^PvbL ^PPvb2, JB*#Md»bBai»TM, 

(here, this, this way, this one) r-£;ft,j N r^ 0 *>j. r^-^tjj 

25 (there, that, that way, that one) ^{d*f/£-f 5}f;^ig£ LT, ^# X V JgfciS 

farther down there, over there, etc. S) 1HMb&1tlb* - *l tf> Jg^fg 

■tti:t>h. r^-j^ rfctbj, rfco-^j, rfc*>f>J ^i'tfofcl^ (farther 



WO 2004/052597 



18 



PCT/JP2003/015484 



down there, over there *$&"£*-*-5l&*iS«:teffl Lfc#£0 T^rj \^ 

ttj (there, that one) T'^Sg^J; 19 ^V^^^^ii^fc^^ ^ 

b fc^S 3 m O R <E>*Ml!j £ ft -5c 

^Lfc#^@^rRj^ B^agp 1201a f om^tz.m^(D^m^(D 

fc^JHWr, *5SV^2 Omt^l 0 Om£A±«fnTV^S«t I"- 
r^Hj (this, that) ^T*^-r<D{c^t^^Bgg|tt^^- £fca5fc£<K 

Tfcixj (over there, etc) £ teWfcrf % T^^j (that) tW 0 ©^«**!*»6>-C 
iS^fipC, r-o^j (this or this way) £V>?if^ig&, D^yhR 

m^^mm<Dm^mx<om^MK^m^ r — j r-ttj (here, this) -e 

£fc> m^Mt^T^y bR&T&^M&ia^ r-*j (here) £ 5 Jg^iTC 
%t<0&&thZ>mWb, r^e-j (there) £ ir^5«*»K:»9j&**L6««a:3asm/j; 

*4 4T?«*Sixfc*«: % fMHMll 3 0*rttT?fc< % 1 3 

5 IZhAtlZtlZo ^mm&n 13 511, M^tf-vf ? 44 U^^f ? t 
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(ommz.'^M.v* rg attwije^aj mjaMst-So § B&s^Jg^fe^ lt«, 

GPS 4 6 -C&tfj &£<Z>fl? « t , J*a^-fe yf48 Lfc 

4 8^fl^^T«t«3i^m^(CgBffie ; Sr*i^i--5rit>-C#'5o H) 
MHftttl 2 0T?WttLfc4fe#©1**i:, mm^r 1 5 OA^ML 

-46 2» £ bfc g B#ff HR£-*-* £ £ T\ £ teffiflf&te g B#g&jf^ 
&fly#LTV^ 0 If^tLTtt, SRE0>*-?ifc*ttf % #U fi, £ N #^"C*> 

fcMfclff t^oT, CTnaKjy hRCTf Zhzmfob LTt> «tV\ 

i**4s>£ utiftia^-^^-^ i 5 o (Dmm?~?\z.w(kiim-fz> «t 5 curs <t N 
^in, &tmwm 1 1 4 ^w-r-So 
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t, -ttsr rH^nwffi^H^j <tv^) ^ramis 1 3 o xm <o Tkh,im 
io iwr^ftv^v^^sr-rso 

15 fa M*-tftf-Ji>&mk*>&m&li. : t<D'PX*mmtj:M&m&J:5izLXi>&^ 
20 #S$*bfcffi« (*>SlB*r#o/t#|3K\ fc5ffi«&#o#a©»£t>*>5) V 

* l-or 9 i&*tLfc«* b i, b 2 1 mwmmsnm^t t 
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vw, Vb2<Dmmm& t<z>x&mb2, bs&«Mtu :©i«b2, bs^avejx 
®Wi&mmmmi®i 1 ^&«&^i 1 lx^^titiw^m^ 
5 « % re$«»«i«isi 12a, &m.m®mjzmi 12b, -^-v^^^asi 1 

10 ®ttz > mm&G'tz><> Mfcftizi^ m7m (a) iz^rx^izo^y hR**^ 

(M«3 6 0° /128) r<b^^^EH^eiV^c<b^ 
#t&M£tf>ji:*lLi<K Liu Li 2 tf>3L&Pio, P11, Pi2&I^^O#:g<!;i§|$-r5 0 

*ttmR£«B 112b («?&tt*K£4Mfc) rau wmsitt mat** 

20 ^0^®^-fL^^7|H (a) -C^$*t5J;5&iaMft taRB 
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